Film Comic Generation with Eye Tracking

نویسندگان

  • Tomoya Sawada
  • Masahiro Toyoura
  • Xiaoyang Mao
چکیده

Automatic generation of film comic requires solving several challenging problems such as selecting important frames well conveying the whole story, trimming the frames to fit the shape of panels without corrupting the composition of original image and arranging visually pleasing speech balloons without hiding important objects in the panel. We propose a novel approach to the automatic generation of film comic. The key idea is to aggregate eye-tracking data and image features into a computational map, called iMap, for quantitatively measuring the importance of frames in terms of story content and user attention. The transition of iMap in time sequences provides the solution to frame selection. Word balloon arrangement and image trimming are realized as the results of optimizing the energy functions derived from the iMap.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Application of eye tracking technology for screening and rehabilitation of children with special needs.

Eye tracking is a technology for measuring eye movements when looking at a point. The length of time to look at a particular situation, the sequence of observations, as well as points of attention are processed in the process of eye tracking and eye movements are identified by topics such as fixation, saccade, etc. Information about how the eyes move at a special moment has many potential appli...

متن کامل

Multimedia asset management for post-production

This paper describes the ongoing development of tools for assisting the management of large volumes of visual data in film and television postproduction. By integrating recently developed content-based image retrieval techniques into an existing asset tracking framework, we can facilitate reuse of archived material by making the contents of the archive searchable on the basis of visual content....

متن کامل

Analysis of Gaze on Comic Book Panel Structure

Comics have been shown to be able to tell a story by guiding the viewers gaze patterns through a sequence of images. However, not much research has been done on how comic techniques affect these patterns. We focused this study to investigate the effect that the structure of a comics panels have on the viewers reading patterns, specifically with the time spent reading the comic and the number of...

متن کامل

Cinema comics: Cartoon generation from video stream

This paper presents CORVIS(COmics Rendering system on VIdeo Stream) which helps to create comic strips from video streams in semi-automated manner. For this, first we manually select a set of important featuring scenes in a cinema and transform them into simplified illustrations by Mean-Shift segmentation. Then we insert the stylized comic effects to each illustration by considering the before/...

متن کامل

Writing Visual Culture

This article examines the recent emergence of the motion comic as part of a growing relationship between comic books, animation and new forms of digital entertainment and distribution. Motion comics typically appropriate the narrative and ‘static’ artwork of a comic book, which is then manipulated by animation software such as Adobe’s After Effects to create an impression that is similar to pap...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2013